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ABSTRACT 


This study developed an objective procedure for identification of 
probable sensor and mission characteristics for an operational 
satellite land observing system. Requirements were systematically 
compiled, quantified and scored by type of use, from surveys of 
federal, state, local and private communities conducted by the 
National Oceanic and Atmospheric Administration (NOAA). Incremen- 
tal percent increases in expected value of data were estimated for 
critical system improvements. Comparisons with costs permitted 
selection of a probable sensor system, from a set of 11 options, 
with the following characteristics: 30 meter spatial resolution 

in 5 bands and 15 meters in 1 band, spectral bands nominally at 
Thematic Mapper (TM) bands 1 through 6 positions, and 2-day data 
turnaround for receipt of imagery. Improvements were suggested 
for both the form of questions and the procedures for analysis 
of future surveys in order to provide a more quantitatively pre- 
cise definition of sensor and mission requirements. 
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INTRODUCTION 

Digital images from orbiting land observing systems have been 
available on an experimental basis since 1972 from NASA's Landsat 
satellites. The 4-band raultispectral scanner (MSS) has been the 
primary sensor on Landsats 1-3. The 4 contiguous bauds from 0.5 
through 1.1 pm (micrometers) on the MSS have been expanded to a 
thermal infrared band and 6 narrower, more advantageously located 
visible, near and middle infrared bands (0.45-2.2 pm) on the 
Thematic Mapper (TM) scanner scheduled for flight on the second 
generation, experimental Landsat-D system in 1982. As a result 
of Presidential Directive Number 54 in November 1979, the National 
Oceanic and Atmospheric Administration (NOAA) has been given 
responsibility for the planning and operating of the civilian 
operational land remote sensing system (NOAA, 1980). Consequently, 
NOAA took responsibility for defining the first generation opera- 
tional system which will probably fly in the 1990's. 

During feasibility and definition trade-off stages it is desirable 
to compare benefits of sensor and mission options to cost. In 
order to perform a sensitivity analysis of the almost infinite 
options, it is desirable to quantify the relative "value" of 
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systoD options on a nunerlcally continuous scale. Establishing 
a credible quantitative value is particularly difficult because 
system characteristics must be fixed many years ahead of flight, 
before the user Is thoroughly fMnlllar with the va:ue of preceding 
systems. 

In 1980, scientists and engineers at Goddard Space Flight Center 
completed a user-based requirements study to Identify a "most 
probable" sensor system for a potential NASA demonstration of the 
NOAA operational mission. .n past studies devoted to the Identi- 
fication of desirable sensor systems, performance characteristics 
and attendant supporting flight and ground systo'ns were developed 
from a qualitative concensus of collected subjective opinions 
based on broad, knowledgeable experience In remote sensing (the 
"wise man" approach). This study developed means to more quanti- 
tatively examine user perceived requirements and compare them to 
costs in order to identify a system of high net value to users. 
This paper describes the process, the system Identified through 
Its use, and possible Improvements for future user requirements 
surveys . 

METHODOLOGY 

As the system to be defined emphasized operational rather than 
experimental use, the operational user community needs were con- 
sidered in the main to define the system characteristics. NOAA, 
as the agency responsible for operational land observing systems, 
aggregated and confirmed the validity of hundreds of user 
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questionnaires from federal, state and local governmental groups 
as well as from Industrial and Individual users. Tabulations of 
these queries were the primary source for a requirements data 
base. The constantly evolving data base was scanned at the outset 
of this study to estimate the range of requirements, and from this 
range, modified by perceptions of engineering and/or budgetary 
feasibility, 11 sensor options were chosen. Then relative quan- 
titative "values" of the performance capabilities of the options 
were determined. Three methods were used to estimate value. Two 
depended upon information In the NOAA Users Data Base. They were 

(1) annual anticipated scene volume requirements, i.e., total 
number of 185x185 km images per year the user would order, and 

(2) user requirements met, i.e. , a relative measure of how well 

a particular sensor option met the user's operational requirements. 
The third method was an independent check on the first two: Dis- 

cipline panels identified user requirements, as perceived by 
scientists, in a manner similar to that used to develop the NOAA 
data base. This "Methodology" section contains a description of 
the NOAA data base, the 11 sensor options, and the methods by 
which the 3 quantitative sets of scores were developed. 

1980 NOAA USER DATA BASE 

To provide a preliminary assessment of user needs for an opera- 
tional system, NOAA synthesized information from a variety of 
sources dating as far back as 1977. Federal agency input was 
obtained by NASA as part of a 1979 study known as the Integrated 
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Remote Sensing Systems Study (IRS ), through questionnaires 
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provided to rennste sensing specialists In the U.S. Department of 
Agriculture (USDA), the U.S. Department of the Interior (UfJDI), 
the U.S. Army Corps of Engineers, and other federal agencies. 

These specialists gathered requirements from programs within 
their agencies. During early 1930, NOAA validated these require- 
ments by requesting each agency to reexamine and verify the 
Information. Since these federal responses usually represented 
the official agency positions, the responses provided a sys- 
tematic inventory of the interest and commitment to land remote 
sensing at that time. Furthermore, because these federal surveys 
often represented reassessment of earlier more detailed NASA sur- 
veys, there was a commonality and utility in them that had never 
been achieved before in terms of potential for quantitative reduc- 
tion of the data. State and local requirements were summarized 
from the Intergovernmental Science Engineering and Technology 
Advisory Panel (ISETAP) report. State and Local Government 
Perspectives on a Landsat Infoi-matlon System (ISETAP, 1978). 
Private sector requirements were drawn primarily from the Geosat 
Committee Report, Geological Remote Sensing from Space (Geosat, 
1976) and foreign requirements were taken in part from Resource 
Sensing from Space, Prospects for Developing Countries by the 
National Academy of Sciences (NAS. 1977). This material was 
supplemented with information from other reports and from per- 
sonal contacts by Metrics, Inc., which organized this data base 
for NOAA. For convenience in further analysis, the non-federal 
inputs were entered on the same type of questionnaire as had 
been used in the federal survey. This data base preceded 
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material from the NOAA questionnaires distributed In March 1980 
at 5 regional user conferences (Metrics, 1980; Spann et al., 

1981). 

A total of 165 sumnary user survey sheets made up the data base, 
representing perhaps thousands of requirements as submitted by 
the federal, state and local governments, foreign users, and the 
private sector. An Illustrative example of such a sunnmry sheet 
Is shown In Figure 1. The agency or organization sutnnlttlng the 
Input was Identified on the sheet as was the programmatic cate- 
gory selected from the list In Table 1. Thus, for example, If 
3 agencies had programmatic responsibilities for monitoring forest 
conditions, each would have a separate requirements sheet which 
summarized that agency's needs for spectral and spatial resolu- 
tion and timeliness. Programmatic priority was assigned by each 
respondent based on the Importance of that program compared to 
the full range of programs for which that agency was responsible. 
Not everyone played the "game", e.g., one user assigned high 
priority to all programs on the basis that all were equally essen- 
tial to meet programmatic requirements. Coverage requirements 
were separated by users into domestic and foreign. The user was 
asked to identify both optimum and minimally acceptable spatial 
resolutions, spectral bands, and the percent of programmatic 
requirements met by each. The survey also requested evaluation 
of the significance of satellite Imagery in obtaining the required 
spectral and spatial information. These responses from users 
formed the basis for calculations of the value of each sensor 
option. 
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•SIGNIFICANCE A (ESSENTIAL TO INCLUDE SATELLITE DATA). B (IMPORTANT), AND C (UNIMPORTANT) 



There were a n\mber of weaknesses In this NOAA user data base. 
First , several of the anmvers inire iK>n-niBserieal and tterefore 
required scwtewhat arbitrary assignaent of nwMrical replacMents 
in orddr to be useful in value calculations. Second, mnam of tte 
surveys were gathered in different formats; for exaevle, the 
inputs frcHB the federal government and private industry nwre not 
equivalent. Third, not all swonary sheets were ad^uately repre- 
sentative, especially with regard to potential non-federal users. 
Fourth, inputs were gathered over several years in a new high 
technology field where requlr^ants, knowledge and exiMrience 
are changing rapidly. Fifth, considerable differences existed 
in the capability and thoroughness of the users in interpreting 
and answering the requested information. Sixth, there was no 
clear statement of whether these were current or future require- 
ments. Finally, some groups provided inconsistent or inc<Mq>lete 
information on certain subjects, necessitatisg assumptions or 
inferences for the current analysis. Categories most frequently 
affected were data volume requirements, priority of requirements, 
and percent of requir«nents met. Altlk>ugb these difficulties 
Inherently limited the precision of predictions based on this 
1980 NOAA user data base, this nevertheless represented the most 
cosqplete and focused aggregation of perceived user needs to date, 
provided a satisfactory basis for developmnt of a procedure 
fo'i* quantitatively scoring the relative vali»s of various sensor 
options. 
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SENSOR OPTI(»<S FOR THIS STUDY 


Ideally, the choice of a'msor options for consideration should 
be made from the optimization of performance for spatially and 
spectrally continuous variables. Unfortunately, the necessary 
mathematical functional relationships do not exist. Therefore, 

11 options were created from a few discrete choices of spectra?, 
bands and spatial resolutions which appeared to bound practically 
achievable user requirements. The sensor options which were 
chosen are given in Table 2. 

Spectral options included bands in the visible (0.4-0.76 ym) and 
near infrared (0.76-1.0 yro) regions similar to that currently 
available in the Landsat MSS, two shortwave or middle Infrared 
(SWIR 1.0-2. 5 ym bands) and one theztaal infrared (TIR, 10-12 ym) 
band. The data did not reveal any major' requirement for bands 
beyond the 7 proposed for TM (Thematic Mapper scanner planned for 
Landsat-D launch in 1981). Thus the nominal band locations for 
the various options were set at TM band locations, but it should 
be emphatically stated that the precise band locations and widths 
for an operational system should be the subject of detailed study. 
Thrt^e spectral options were quantitatively examined in this study: 
1) 4 bands in the 0.4-1 ym region, 2) 6 bands in the 0.4-2. 5 ym 
region, and 3) 7 bands in the 0.4-12.5 ym region. The 11 options 
contain 3 major spatial groups — nominally 80-meter, 30-meter and 
10-meter systems. These are consistent spatiMlly with the mini- 
mum, middle and maximum candidate sensors for a fully operational 
system Initially identified by NOAA (1980) in a preliminary 
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analysis of the data base used in this study. The range of spec- 
tral and spatial options thus varied from the existing MSS capa- 
bility to a high resolution multiband option adiich approached the 
limits of technical and political feasibility. Recent work which 
utilized the 40-meter panchromatic band of the Roturn Beam Vidicon 
(RBV) on Landsat 3 to "sharpen" the resolution of the 80-meter MSS 
(e.g., Cox and Roller, 1981) indicated that a single band at two 
or three times the resolution of the other bands in the system 
was potentially useful for two reasons: boundary definition was 

increased for visual interpretation and training site selection, 
and errors in supervised classification procedures could be 
reduced by the labeling of mixed pixels (picture elements) which 
contained more than one type of category. Therefore, options 
with one band of higher resolution than the other bands in the 
visible portion of the spectrum were included (options 2, 3, 5, 

7 and 8). The mixed spatial resolution of options 10 and 11 
(and the thermal band on option 8), however, were due to engi- 
neering constraints in the shortwave and the thermal Infrared 
regions. 

ANNUAL SCENE VOLUME REQUIREMENTS 

One measure of "value" between various sensor options was the 
demand, in the sense of scene volume, each generated. In the 
NOAA data base, the users estimated the annual volumes of 
185x185 km scenes they would need from their "optimum" and "mini- 
mum" acceptable systems to meet Identified programmatic objec- 
tives. In this study, the annual scene volume requirements 
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to tho 11 ooBaor optloaa woro oalculttod for each data 
baaa iaput <«.g. , Flguro 1) uaing the follovlag 4 atopa (all 
daaoriptora la quotatloaa rafar to data fro« tha data baaa) : 

(1) for aaaaor optloaa whoaa spatial aod apactral charaotarlatlcs 
vara laas thaa "mlalamuR aocaptabla*' tha voluna was dafinad'aa 
zero, (2) for sanaor options whose oharactariatics vara batwaan 
tha usar daflnad "minimum*' and "optimtui*' tha ''minimum volum" 
was asslgnad (a.g., 400/50 scanas/yaar in Figura 1 for domestic 
and foreign raquiramants) , (3) for sanaor options whose charac- 
teristics equaled or exceeded the "optimum raquiramants'' tha 
"optimum volume" (600/100 in tha example) was assigned, and 
(4) the volume number In step (2) or (3) was multiplied by a 
timeliness factor. 

Timeliness factors were defined as the number of days from acqui- 
sition to receipt by a user and reflected the decreasing value 
of data with time. For timeliness better than or equal to "opti- 
mum" (7 days in the example) the "Optimum Percent of Requirements 
Met" (do percent in the example) was assigned as the timeliness 
factor. For timeliness poorer than "minimum acceptable" a aero 
value was assigned. In between, a linear interpolation on a log- 
log plot between the graphical points ["optimtmi timeliness" 

(7 days)— "optimum percent of requirements met" (90 percent)] 
and ["miaiffluffl timeliness" (30 days) — "minimum percent require- 
ments met" (70 percent)] was used to assign a value (or the 
factor. When no tim.^lineaa was given, the timeliness factor 
was set at unity. 
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The volvunee calculated from each user data sheet were added 
together to yield total estimated scene volumes, by user conmunlty 
and by discipline area, for various choices of sensor options and 
timeliness. These volume requirements are not to be equated with 
scene sales, since a given scene might be used to satisfy several 
measurement objectives by a given user. However, tbe pattern of 
volume distribution should be a reasonable guide to relative 
user-perceived sensor option value and to the importance of data 
turnaround. 

There are a number of uncertainties and assumptions in these annual 
scene volume requirements. The estimates did not take into account 
iL^reases in image costs for improved imagery, nor availability of 
subsets of a standard scene. The volume estimates on the data 
base sheets were only related to optimum and minimum spatial 
resolution; volume requirements related to coverage frequency 
were not indicated, and the effect of timeliness was often not 
estimated. Since volume estimates were invariably listed only 
in the "spatial resolution" row of the forms, no distinction in 
volume was possible between minimum and optimum spectral configu- 
rations. The mo.st important assumption was that official federal 
approval of these requirements by Individual agencies had an 
averaging effect on the uncertainties and probably kept the 
volume estimates within feasible budgetary limits and the coverage 
capability of a satellite mission. 
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USER REQUIREMENTS SCORES 


A related measure of the potential utility of the sensor options 
can be computed from the significance attached by the users to 
spatial and spectral performance parameters, and the degree to 
which the parameters for each sensor option met their requirements. 

A procedure was developed for obtaining a single user score of 
requirements met for each of the 11 sensor options, using 
5 quality factors derived from the user's questionnaire: "Spatial 

Value", "Spectral Value", "Spatial Significance", "Spectral Sig- 
nificance", and "Programmatic Priority". A relative number for 
each of the quality factors was determined as a function of sen- 
sor option. The product of these 5 numbers for each sensor option 
provided a relative measure of how well the users perceived that 
an option met their requirements. As in the annual scene volume 
case above, each user data sheet was analyzed separately before 
aggregating. The next several paragraphs describe the methods 
for determining a score for the quality factors using data from 
Figure 1 as an example. 

A "Spatial Value", expressed as a fraction, was determined for 
each option from a linear interpolation on a log-log plot of "per- 
cent of requirements met" versus the "parameter values" for spatial 
resolution. Log-log interpretation was used because of the geo- 
metric rather than arithmetic nature of these data. For example, 
using data from Figure 1, a straight line was drawn on a log-log 
graph between the optimum "percent of requirements met" of 
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90 percent at the "optimum" resolution of 30 meters and the cor- 
responding "minimum acceptable" point of 70 percent at 80 meters. 
For 80 meter systems with a 40 meter sharpening band, the effec- 
tive IFOV was assumed to be the average, 60 meters; similarly, 
the 30/15 systems were assumed to have an effective IFOV of 
22 meters. Therefore, the effective ground IFOV's for the 11 
options were taken to be 80, 60, 60, 30, 22, 30, 22, 22, 10, 10, 
and 10 meters, respectively. For sensor options above the opti- 
mum, the "spatial value" number was assumed constant at the 
"optimum" (e.g., better than 30 meters * 90 percent of require- 
ments met for Figure 1). For options not meeting the minimum, 
the number assigned was zero. Inputs for state and local govern- 
ment and for private industry did not include data for "percent 
of requirements met". In these cases, 100 percent was assumed 
for optimum and 80 pezcent for mlnimiim, since this represented 
a typical pattern of users. 

Since spectral parameters were discrete, the "spectral value" 
could not be estimated In such a continuous fashion. The number 
assigned to "spectral value" was set at the "optimum" or "minimum 
value as given In the questionnaire for each option that met the 
optlmtun or minimum spectral requirements. Using Figure 1 as an 
example, the value was 0.80 for all options except 8 and 11 which 
received the "optimum" value of 0.90, because of the thermal capa 
billty Included In these options. In a few cases where "percent 
of requirements met" was only noted for the spatial parameters, 
the same values were assumed for the "optimum" and "minimum" 
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spectral values. The VIS/NIR hands of the l^S and TH viwre con- 
sidered to be essentially equivalent for the purpose of comparing 
sensor option characteristics. "Spectral value" was set at zero 
If the option did not meet the minimum spectral requirements. 

Three of the factors used In calculating the user requirement 
scores from the survey sheets were qualitative. In order to per- 
mit a quantitative scoring of user requirements, the "spatial and 
spectral significance of satellite data" responses were assigned 
one of three values as follows: A (essential to Include satellite 

data) ■ 1, B (Important) - 0.5, and C (unimportant) ■ 0.1, Simi- 
larly, the qualitative "Programmatic Priority" of high, medium, 
or low was assigned a numerical value of 1, 0.5, or 0.1, respec- 
tively. For the example In Figure 1, "Spatial Significance" ■ 1, 
"Spectral Significance" ■ 1, and "User Priority" ■ 0.5. The some- 
what arbitrary choice of the three relative weighting factors 
assured minimal Impact of low priority items. 

As mentioned earlier, a user score of requirements met for each 
option was obtained by multiplying these five factors together 
and then producing an Integer value by multiplying by 100. For 
example, option 1 with MSS bands at 80-meter resolution would 
have a user score from the data in Figure 1 of 28 (Spatial Sig- 
nificance ■ 1.0, Spatial Value ■ 0.70, Spectral Significance « 

1.0, Spectral Value ■ 0.80 and Programmatic Priority ■ 0.5). For 
option 11, the user score Is 40.5 (1.0 x 0.90 x 1.0 x 0.90 x 0.5 x 
100). Thus a single score is produced for each option for each 
survey sheet. 
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Computations of these user requirements scores were performed for 
all survey sheets. In cases where foreign and domestic parameters 
differed, separate calculations were carried out. The 165 Indi- 
vidual sets of user requirements scores were aggregated to produce 
a single score for each option. The aggregation was performed In 
three averaging steps: from Individual user scores to 38 program- 

matic category (see Table 1) scores, then to 10 user discipline 
scores (forests, soils, etc.), and finally to a grand weighted 
average score. Simple arithmetic averaging was not employed In 
aggregating scores because that process would have assigned equal 
Importance to all users, all programs and all disciplines. The 
users' own estimates of data volume requirements associated with 
a given progrananatic category provided the means of weighting. 
User-perceived volume requirements were rounded into three volume 
weighting factors: 0.1 for volumes up to 100 scenes per year, 

0.5 for volumes between 100 and 1000, and 1 for volumes greater 
than 1000. These limits on annual volume requirements weighting 
factors were increased by a factor of 10 for the final aggregation 
of the 10 disciplines. 

PANEL REQUIREMENTS SCORES 

In order to provide an independent check, and perhaps a more 
prophetic measure of user requirements, four panels of remote 
sensing specialists were convened at ''oddard Space Flight Center 
and asked to fill out questionnaires similar to those used in 
forming the data base. The specialists were shown neither the 
completed user questionnaires nor the method of scoring, in 
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order to avoid the possibility of the panels being influenced by 
the data base analysis. It was felt that the user Inputs might 
be biased by the state-of-the-art as they knew it , especially 
since some of the state and local surveys were taken several years 
ago. Scientists, on the other hand, might be cognizant of research 
that users have not seen. Thus panel requirements scores were 
seen as a powerful check on the user scores. Panelists were also 
asked some key questions that were not fully covered in the user 
survey, such as requirements for repeat frequency coverage. 

The methodology for arriving at panel scores was identical to 
that for the users. Questionnaire sheets from the panelists con- 
sisted of single Inputs for each of 35 programs (see Table 1), 
rather than multiple inputs from each program as in the users' 
data base. Panelists did not complete survey sheets in the ocean 
discipline (currents, tides, bathymetry, and ocean pollution) and 
added one programmatic category in geology (episodic events). 

ANNUAL SCENE VOLUME REQUIREMENTS SCORES 

Table 3 shows the annual volume of scenes required by potential 
users as a function of sensor option and timeliness, suimned from 
all 165 user data sheets. As expected, the scene volume require- 
ments dropped with increasing time between acquisitioa and 
receipt. However, as there was little change between 1 and 2 
days, the volume figures for the more likely 2-day timeliness 
(highlighted in Table 3) were used in subsequent discussion. 

Also, due to the general ordering of options from lowest to 
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UlSITION AND RECEIPT BY USER 


1 

i 

highest spectral and spatial resolution, tho scene volumes 

j 

Increased with option number. Some of these Increaoes were dls- 

, i 

continuous, prestunably due to some programs being enabled for 
the first time rather than simply enhanced. The maximum soene 
volwne In Table 3 of 100,000 scenes per year for option 11 and 
1-day turnaround would be increased by only about 35 percent if 
all the spatial and spectral requirements Identlflfd In the data 
base could be met — including 2-meter spatial resolution. 

More detailed tabulations of volume requirements are given in 
the Appendix. Appendix 1 gives the annual scene volume require- j 

ments by option for each of the 10 disciplines and for 6 values 
of timeliness from 1 to 324- days. Appendix 2 gives a breakdown 
of the 2-day timeliness volume requirements in Table 3 by the 36 
programmatic categories. Finally, Appendix 3 shows the same 
total volume requirements by option for 6 types of user communities. 

USER AND PANEL REQUIREMENTS SCORES 

Relative user scores of requir«sents met for each option are 
given in Table 4 as a function of discipline. The weighting fac- 
tors, based on scene volumes, used to compute the weigdited averages 
are also shown. Finally, the science panel scores of requirements 
I met are shown in the same manner in Table 5. Appendices 4 and 5 

are breakdowns by programmatic category of user scores and panel 
scores respectively. 

Two of the 3 measures of perceived value are shown in Figure 2 
where user volume requiren^nts for a 2-day timeliness are compared 
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with th« uMr scores. Scenes per year and mmerloal scores are 
plotted on a log scale t.o pezialt easier comparison of percent 
differences between options. The similarity bets^s these two 
measures of "value" from the users' data base is apparent; on 
an optlon-by-option basis the relative agreement is approxi* 
mately ;flO porcent. These two user values are not com>i«tely 
Independent measures, since a) the same groups did each, 
b) scaled scene volume was used to aggregate requirements mt, 
and c) requirements met was used as a multiplicative faqtor in 
estimating volume .equlrements by option. 

A coag>arison of user and panel requirement scores is shown in 
Figure 3 using weighted average values derived from Tables 4 
and 5. Hie first and most important observation is that 
Increases and decreases by option are nearly identical for users 
and panelists. However, the panelists did rate options 1 and 2 
much lower in relative "value" than the users. Overall, the 
fact that these two independent measures of "requirmnents met" 
agree, in a relative sense, tends to give additional credence 
to both of them. 

INCEElf£NTAJ< SPATIAL AND SPECTRAL VALUE 

Spatially, there are several ways to look at the Ingiact of 
improvments represented by the 11 options. To a first *’approxi- 
matlon, there are 5 spatial options. Options 1, 4 and 9 each 
have 4 VIS/NIR spectral bands at a single resolution, l.e., Srf). 
30, and 10 meters, respectively. For som^} options one visibLe 
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USER AND PANEL PERCEPTIONS OF REQUIREMENTS MET 
INCREMENTAL VALUE OF SPATIAL IMPROVEMENT 



MLA SENSOR OPTIONS 
Figure 3 


band has been "sharpened" by a factor of two in spatial resolu- 
tion, to 40 laeters (options 2 and 3) and 15 meters. The effec- 
tive resolution of the system for each option has been assumed 
to be intermediate between the range of values in the VIS/NIR 
region, 60 meters for options 2 and 3, and 22 meters for options 
5, ? and 8. 

Spectrally, the comparison among options is limited to three 
combinations: four VIS/NIR bands, six VIS/NIR/SWIR bands, or 

seven VIS/NIR/SWIR/TIR bands. There are four comparisons which 
isolate the increased "value" expected from the addition of the 
two SWIR bands to the four VIS/NIR bands. These are comparisons 
between options 2 and 3, 4 and 6, 5 and 7, and 9 and 10. Simi- 
larly, there are two comparisons for as??essing the expected 
change due to the addition of a thermal band: options 7 and 8, 

and options 10 and 11. 

Spatial comparisons by option of the user requirement scores are 
highlighted in Figure 3. Three comparisons between 80-meter 
systems (options 1, 2, and 3) and spectrally similar 30-meter 
systems (options 4 5, and 7) all show about a 45 percent 
increase in user score due to improved spatial capability. Com- 
parisons between 30-meter and spectrally similar 10-meter systems 
(5 and 8 to 9 and 11) show a lower, approximately 10 percent 
increase in user scores even though there is a factor of three 
improvement in spatial resolution. 
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Using this technique, the percentage incremental Improvements in 
value caused both by spatial and spectral improvements was deter- 
mined for all three value measures: annual scene volume require- 

ments for 2-day timeliness (from Table 3), user scores of 
requirements met (from Table 4), and discipline panel scores of 
requirements met (from Table 5). While there was always an 
enhancement of performance with an Improvement in sensor charac- 
teristics, the relative incremental improvement was much greater 
in some cases than in others. Value enhancements, expressed as 
percentage Improvement, are summarized in Table 6. These are 
average values based on option-by-option comparisons sutmnarized 
in Appendix 8. More detailed comparisons among the 10 disciplines 
are provided in Appendices 6 (users) and 7 (panel scientists). 

All three "value" categories showed a dramatic increase of at 
least 40 percent in the value of 30-meter data as compared to 
imagery taken at 80 meters. The average increase in value by 
improving spatial resolution from 30 to 10 meters was less than 
20 percent. Discipline panelists perceived SWIR to be twice as 
valuable as users, probably because of the greater experience of 
scientists with SWIR data. None of the three estimates of the 
increased value of the addition of TIR exceeded 20 percent, 
possibly indicating a lack of familiarity with thermal data. 

VALUE-TO-COST RATIOS 

The final step in the analysis was to calculate a "value" to 
mission cost ratio, to determine which option was most cost effec- 
tive. Costs were based on estimated total expenditures by the 
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government for sensor development, a demonstration mission, and 
a 10-year lifetime for an operational land observing system, 
including the ground system development and operation, but 
excluding any cost for information extraction. The costs to the 
government, relative to the cost of the most expensive option, 
are shown on the first row of Table 7. The value-to-cost ratios 
for each option, normalized to 100 for the highest ratio in each 
test, are shown for the three measures used in this study, namely 
those derived from: Table 3, User Volume for 2-day timeliness; 

Table 4, User Requirements (weighted average); and Table 5, Panel 
Requirements (weighted average). Value-to-cost ratios are given 
by discipline in Appendix 9 for both user and panel scores. It 
can be seen from Table 7 that even though options 9, 10 and 11 
have higher values, the value-to-cost ratios peak around op- 
tions 6, 7 and 8, with option 8 having the highest total score. 
This is due to mission costs rising more rapidly than "value" as 
a function of performance. Actually, due to the lag in develop- 
ment of thermal IR solid state detectors compared to visible and 
SWIR detectors, and the closeness of the value-to-cost ratios for 
options 7 and 8, option 7 would be the choice if only solid state 
sensor.s were used and an early launch date was a criterion. 



FREQUENCY OF COVERAGE 


I 


As stated earlier, this 1980 NOAA data base did not contain some 


information which was essential for a first level definition of 
an operational system. First and foremost was temporal information 


about the required frequency of observation. This meant questions 
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such as swath width, orbital swathing patterns, number of satel- 
lites in orbit at any time, and need for across track pointing 
could not be assessed from the user surveys. Therefore in the 
study reported here, the four discipline panels were asked to add 
temporal resolution to the evaluation, in the same manner as spec- 
tral and spatial resolutions were handled, i.e., optimum and 
minimum values were reported with the percent of requirements met 
for each. The results are summarized in Table 8 for cloud-free 
conditions. The shortest repeat cycles that received a 50 percent 
or greater value were highlighted. Imagery acquired less fre- 
quently than this might not be useful at all. 

Landsat 1-3 statistics indicate about a 10 percent chance of 
acquiring a nearly cloud-free scene. Agricultural and agronomic 
requirements for a usable scene every 8 days necessitate more 
frequent observations to allow for cloud cover. For 5 by 6 km 
agricultural segments, the probability is more like 50 percent 
of obtaining cloud-free images 3 days apart. This global require- 
ment might be met by two 16-day repeat nadir-looking satellites 
able to look off-track as much as two scenes. The 4 to 8 day 
repeat view for regional and urban planning was the most stringent 
discipline need. It could not be met with a two-satellite system 
unless the systematic acquisition of imagery could be occasionally 
relaxed to provide dedicated coverage over a few targets. Clearly, 
adding satellites and pointing capabilities will affect system 
complexities and costs. Neither user surveys nor discipline 
panels were useful in evaluating these complex acquisition 
requirements . 
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STEREO 


Stereo requirements were requested on the forms in the NOAA surveys. 
Forty-four of the 165 responses identified stereo requirements, but 
not enough parameters were given to permit a quantitative reduction 
of their requirements. Base-to-height needs ranged from 0.4 to 1.0 
with spatial resolution of at least 20 meters. Future surveys 
should identify, at a minimum, base-to-height ratio, number and 
location of spectral bands, expected scene volume, nadir spatial 
resolution, and if side-to-side, fore-aft, or fore-nadir-aft 
stereo is required. 

SUMMARY 

Analysis of user requirements, validated by panels of scientists, 
allowed selection of an operational satellite remote sensing sys- 
tem from a set of 11 options. Characteristics included 3 visible 
(VIS) bands, 1 in the near infrared (NIR), 2 in the shortwave 
infrared (SWIR), and if an early launch date were not critical, 

1 band in the thermal infrared (TIR) region (identical to the 
Thematic Mapper). Desired spatial resolutions were: 120 meters 

TIR, 30 meters SWIR, and 30 meters for all but one VIS/NIR band; 
that one "sharpening" band would have 15 meter resolution. Repeat 
visit requirements necessitate at least a two-satellite system 
with off-track viewing capability. 

While we believe the procedure identified the most suitable of 
the 11 choices, we have no Illusions that the identified system 
is superior to options that were not considered. The value to 


cost ratio for a 20-meter VIS/NIR syst^ might be superior to 
our 15/30 meter mixed resolution options. A 10-meter sharpening 
band might have sufficiently greater value than a 15-meter band 
to offset Increased cost. Additional or different spectral bands 
might Improve the utility of the data. 

Continued research on the spatial, spectral and radiometric capa- 
bilities of advanced systems is essential to provide a firm basis 
for reassessing (or continually assessing) user requirements, and 
to improve approaches for acquiring (e.g., surveys) and analyzing 
user needs. 

Such surveys must be considered parts of an iterative process, 
involving familiarizing users (research or operational) with 
recent technological advances, soliciting requirements in terms 
most meaningful to their work, interpreting the results in 
terms of research requirements (or sensor/system/mission require- 
ments), and feeding the results back to the survey population. 
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3. Annual scone volume requirements, by option and user group. 

4. User scores of requirements met, by option and programmatic 
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6. User incremental spatial and spectral values, by discipline. 

7. Panel incremental spatial and spectral values, by discipline. 
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Appendix 6 
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